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During  this  first  year  under  Grant  AF-AFOSR077-3204 , five 
articles  [1],  [2],  [3],  [4],  [5]  were  produced  by  the  Principal 

Investigator,  R.  T.  Rockafellar.  Writing  of  the  book  manuscript 
[7]  continued.  A doctoral  thesis  [6]  was  written  by  J.  W.  Spingarn. 

Network  optimization . Major  effort  during  the  summer  of  1977 
went  into  the  book,  "Optimization  in  Netv/orks,”  [7],  which  however 
is  still  not  complete.  Three  new  chapters  were  written,  totaling 
over  200  typed  pages.  The  contents  of  these  chapters  are  listed 
at  the  end  of  this  report.  Much  of  this  portion  is  concerned  v/ith 
duality-based  algorithms  for  determining  optimal  flows  and  poten- 
tials, a-’d  some  of  these  algorithms  are  completely  new.  There  are 
numerous  applications  to  new  problems  involving  transportation  net- 
works, logistics,  traffic  routing,  stockpiling,  pipe  systems,  force 
distribution  in  structures,  and  other  situations  in  operations 
research  that  over  the  years  have  ingeniously  been  represented  in 
terms  of  network  flows  and  potentials. 


Stochastic  programming . Continued  collaboration  v;ith  R.  J.  B. 

Wets  has  resulted  in  paper  [1],  "The  optimal  recourse  problem  in 
discrete  time:  L^-multiplier s for  inequality  constraints."  V\’e 
feel  this  is  the  high  point  so  far  in  the  series. 

An  optimal  recourse  problem  is  an  optimization  problem  with 
both  stochastic  and  dynamic  aspects,  involving  the  interplay  of 
observations  and  responses.  In  discrete  time  (with  a finite 
horizon),  there  are  finitely  many  stages,  at  each  of  which  a de- 
cision is  selected  on  the  basis  of  prior  observations  of  random 
events  and  subject  to  costs  and  constraints  affected  by  these 
observations  as  well  as  by  past  decisions.  The  goal  is  to  mini- 
mize expected  cost,  taking  into  account  the  known  distribution 
of  future  random  events.  Paper  [1]  is  concerned  with  the  derivation 
of  necessary  and  sufficient  conditions  for  optimality  in  the  case 
of  convex  costs  and  constraints. 

It  is  shown  that  if  the  recourse  problem  is  "strictly  feasible  

and  satisfies  a new  condition  called  'essentially  complete  recourse, ' " “ 

optimal  solutions  can  be  characterized  by  a pointwise  Kuhn-Tucker 
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property  involving  only  L^-multipliers  (no  singular  coinponents  I ) . 
Applications  to  multistage  stochastic  programs  with  special 
structures  are  developed  in  the  last  two  sections  of  the  paper. 

In  particular,  the  relation  between  the  general  model  and  discrete- 
time stochastic  control  models  is  brought  out  by  applying  the  basic 
results  to  a linear  stochastic  control  problem  with  state  constraints. 

Nonlinear  programming . In  "Monotone  operators  and  augmented 
Lagrangians  in  nonlinear  programjning , " [3],  the  Hestenes-Powell 
method  of  multipliers  is  modified  to  obtain  a superior  global 
convergence  property  under  a stopping  criterion  that  is  easier  to 
implement.  The  convergence  results  are  obtained  from  the  theory 
of  the  proximal  point  algorithm  for  solving  0 c T(z)  v;hen  T is 
a maximal  monotone  operator.  An  extension  is  made  to  an  algorithm 
for  solving  variational  inequalities  with  explicit  constraint 
functions . 

Computational  methods  of  this  type,  using  the  theory  of 
augmented  Lagrangians,  are  now  considered  among  the  best  for  non- 
linear programming  problems.  Much  of  the  theory  for  such  methods 
was  developed  under  the  predecessor  of  this  grant. 

Optimal  control  of  dynamical  system.s . Papers  [4]  and  [5]  are 
in  this  area.  In  [4],  "Duality  in  optimal  control,"  an  expository 
account  is  given  of  the  way  that  the  study  of  optimal  control 
problems  has  been  transformed  by  recent  developments  in  convex 
analysis.  Among  the  topics  treated  are  existence  of  solutions, 
dual  problems,  generalized  Hamiltonian  equations,  and  state  con- 
straints versus  impulse  controls.  This  paper  is  about  60  pages  long. 

Paper  [5],  "Convex  processes  and  Hamiltonian  dynamical  systems," 
describes  in  terms  of  models  of  optimal  economic  growth  a number  of 
results  and  open  questions  concerning  optimal  control  problems  over 
an  infinite  time  interval.  The  main  question  in  such  problems  is 
what  kind  of  behavior  is  naturally  optimal  in  a "self  sustaining" 
sense,  i.e.  in  a steady-state  manner  that  could  be  prolonged 
indefinitely.  The  concepts  that  arise  in  this  connection  are 


interesting  for  several  basic  reasons,  especially  as  a descrip- 
tion of  limiting  behavior  in  various  situations,  even  though  real 
problems  never  involve  infinite  time. 
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Convex  analysis . A relatively  minor  contribution  is  made  in 
"Higher  derivatives  of  convex  functions,"  [2].  This  answers  the 
question  of  what  conditions  are  needed  on  a convex  function  in 
order  to  ensure  that  the  conjugate  function  is  m-tim.es  differen- 
tiable • 

Are  the  standard  optimality  conditions  in  nonlinear  program- 
ming "usually"  satisfied?  This  is  the  question  tackled  by  Jon 
Spingarn  in  his  dissertation  [6] , an  impressive  piece  of  work.  The 
question  is  important  because  it  is  not  possible,  as  a practical 
matter  in  most  applications,  to  check  v/hether  a given  nonlinear 
programming  problem  (P)  satisfies  the  "constraint  qualifications" 
and  strengthened  forms  of  the  second-order  optimality  conditions  on 
which  the  analysis  of  many  algoritluns,  etc.,  depends.  It  is  often 
argued  that  it  is  all  right  to  base  results  on  the  assumption  of 
such  conditions,  because  they  hold  in  "typical"  problems.  But 
what  does  this  assertion  really  mean? 

Spingarn  considers  nonlinear  programming  problems  (P (w) ) 
that  depend  on  a parameter  vector  v;  ranging  over  a set  W c R . 
The  components  of  w may  represent  costs,  availabilities,  demands, 
and  other  variables  that  are  truly  "variable"  within  the  context  of 
a particular  model.  Each  parameterization  of  this  sort  gives  a 
"class"  of  problems.  Let  us  suppose  w is  actually  a random 
vector  governed  by  a probability  measure  on  VI  that  is  expressed 
by  a density  function  with  respect  to  ordinary  k-dimensional 
measure.  We  can  say  that  a property  is  "typical"  of  the  class 
(P(w)),  w € W,  if  the  set  of  w for  v/hich  it  fails  is  a set 
of  zero  probability. 

Spingarn 's  achievement  has  been  to  develop  a strong  and 
flexible  theory  of  the  parameterizations  for  which  it  is  true  that 
the  constraint  qualifications  and  second-order  optimality  condi- 
tions mentioned  above  "typically"  hold.  Besides  the  immediate 
implications  already  described,  it  is  expected  that  Spingarn 's 
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results  will  find  application  in  areas  like  stochastic  programming, 
which  are  concerned  very  directly  with  optimization  problems  that 
depend  on  random  variables. 

This,  by  the  way,  is  a pioneering  effort  that  may  have  m.any 
interesting  consequences  in  optimization  theory.  No  one  has 
previously  tried  to  provide  a solid  ansv/er  to  this  kind  of  question. 
Spingarn  was  supported  for  two  years  as  a Research  Assistant  under 
this  grant. 


Articles  of  R.  T.  Rockafellar  produced  during  this  grant  period . 


[1]  "The  optimal  recourse  problem  in  discrete  time:  L^-multi- 

pliers  for  inequality  constraints,"  to  appear  in  SIAM 
J.  Control  Opt.  (Written  with  R.  J.  D.  Wets). 
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national J.  Appl.  Analysis  1 (1977),  41-43. 
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(0.  L.  Mangasarian  et  al.,  editors).  Academic  Press,  1978. 
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Control  Theory  (W.  A.  Coppel,  editor).  Academic  Press,  1978. 
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appear . 


Thesis  of  J.  W.  Spingarn  completed  during  this  grant  period . 

[6]  Generic  Conditions  for  Optimality  in  Constrained  Minimization 
Problems , Ph.D.  Dissertation,  University  of  Washington, 
August,  1977. 


Book  manuscript  of  R.  T.  Rockafellar  in  preparation . 

[7]  Optimization  in  Networks , to  be  published  by  the  Princeton 

University  Press.  The  contents  of  the  three  chapters  written 
in  1977  are  as  follows: 

Chapter  7:  Linear  Optimization  (66  pages) 

7A.  Linear  Optimal  Distribution  Problem 
7B.  Examples  of  Optimization  of  Flows 
7C.  Linear  Optimal  Distribution  Algorithm 
7D.  Simplex  Algorithm  for  Flows 
7E.  Linear  Optimal  Differential  Problem 
7F.  Examples  of  Optimization  of  Potentials 
7G.  Linear  Optimal  Differential  Algorithm 
7H.  Simplex  Algorithm  for  Potentials 
71.  Elementary  Problems  and  Duality 
7J.  Elementary  Out-of-Kilter  Algorithm 
7K. . Exercises  (31) 


Chapter  8 
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8B: 
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Dual  Problems  (95  pages) 

Convex  Cost  Functions 

Piecewise  Linear  or  Quadratic  Costs 

Optimal  Distribution  Problem 

Conjugate  Costs 

Optimal  Differential  Problem. 

Duality  Theorem  and  Equilibrium  Conditions 

Unbalanced  Cuts  and  Circuits 

Existence  of  Solutions 

Synthesis  of  Subnetworks 

Exercises  (61) 


Chapter 

9A 

9B 

9C 

9D 

9E 

9F 

9G 

91 

9J 


9:  Algorithms  for  Optimal  Flows  and  Potentials  (67  pages) 

Optimal  Distribution  Algorithm 
Optimal  Differential  Algorithm 
Fortified  Algorithms  and  the  Duality  Theorem 
Discretized  Algorithms 
Calculating  an  e-Optimal  Solution 

Optimizing  Sequences  and  Piecewise  Linear  Approximations 
General  Out-of-Kilter  Algorithm 
Sunthesis  Algorithm 
Exercises  (25) 


